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(54) Stereoscopic image processing apparatus 

(57) A stereoscopic image detecting unit (1 0) has a 
first non-volatile memory (19) for storing inherent cam- 
era characteristic data therein and an image processing 
unit (50) has a second non-volatile mennory (7 1 ) for stor- 
ing inherent circuit characteristic data therein. When the 
stereoscopic image detecting unit is connected with the 
image processing unit through a serial cable and video 



cables and then electric power is turned on, the inherent 
camera characteristic data are sent to the image 
processing unit (50). In the image processing unit, 
based on the camera data sent from the image detecting 
unit and the circuit characteristic data in the image 
processing unit, data for correcting the optical disper- 
sion between two cameras and the of signal character- 
istic are established. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the invention 

[0001] The present invention relates to a stereoscopic 
image processing apparatus for a vehicular distance de- 
tecting system and more particularly to a stereoscopic 
image processing apparatus capable of arbitrarily com- 
bining for use an image detecting unit and an image 
processing unit, 

2. Prbrarts 

[0002] Modern advanced safety vehicles are 
equipped with a distance detecting means for detecting 
a distance between the self vehicle and other vehicles, 
obstacles and surrounding objects. Such a distance de- 
tecting means comprises an image detecting unit for 
taking picture images of solid objects, lane markers and 
the like and for outputting image signals and an image 
processing unit for processing those image signals into 
distance infomnation. 

[0003] A typical example of the image detecting unit 
employs optical systems, i.e.. a pair of left and right 
hands cameras disposed in a horizontally aligned rela- 
tion at a prescribed distance apart from each other. 
[0004] The image processing unit successively shifts 
the image signals from the image detecting unit and 
electrically superimposes them one over the other to 
find a best match of two images from the left and right 
hands cameras, so that the distance from those camer- 
as to an object is calculated based on the principle of 
triangulation, 

[0005] Therefore, it is desirable that there is no differ- 
ence except parallax between two image detecting sys- 
tems in optical and electrical characteristrcs. That is to 
say. optical axes of two cameras must be in parallel with 
each other and focal lengths must be identical. Further, 
the difference in aberration characteristic of lenses and 
the deviation amount at the infinite-point also must be 
identical. Further, the sensitivity of image elements and 
the characteristic of signal processing circuits of respec- 
tive cameras must be identical. 

[0006] Similarly, on the image processing unit side, 
the amplitude characteristics such as gain, offset and 
the like of respective amplifiers must be identical. 
[0007] The dispersion of the optical characteristics 
and that of the signal characteristics in both image de- 
tecting systems can be adjusted to some extent on the 
image delecting unit side and on the image processing 
unit side respectively, however the adjustment is still in- 
adequate. Therefore, in addition to this adjustment, a 
look-up table correction in which the correction is made 
based on a table of the sensitivity of image elements, a 
shading correction in which the sensitivity is corrected 
per zone of picture images and the like, are used. That 



is, in the conventional nnanufacluring process, the im- 
age detecting unit is adjusted integrally with the image 
processing unit to equalize characteristics. 
[0008] Hence, it is impossible to combine the image 

5 detecting unit and the image processing unit each of 
which is manufactured independently and this inhibits 
an improvement in productivity. Furthermore, on repair- 
ing in markets, when one of these units must be re- 
paired, the other also must be adjusted. In some case, 

10 the look-up table of the image processing unit must be 
reestablished. 

SUMMARY OF THE INVENTION 

IS [0009] The present invention is intended to obviate 
the aforementioned problems of the known stereoscop- 
ic image processing apparatus. An object of the present 
invention is to provide an improved stereoscopic image 
processing apparatus whose image detecting unit can 

20 be arbitrarily combined for use with the image process- 
ing unit. 

[0010] To attain the object, according to the present 
invention, the stereoscopic image processing apparatus 
comprises a first non-volatile memory provided in an im- 

25 age detecting unit for menr>orizing a camera character- 
istic data for correcting dispersions of characteristics be- 
tween a pair of cameras, a means provided in the image 
detecting unit for reading out the camera characteristic 
data from the non-volatile mennory and for transmitting 

30 the data to the image processing unit, a second non- 
volatile memory provided in an image processing unit 
for memorizing a circuit characteristic data for correcting 
dispersions of characteristics between two circuits of the 
cameras and a means provided in the image processing 

35 unit for correcting image signals outputted from the pair 
of cameras based on the circuit characteristic data read 
out from the second non-volatile memory and the cam- 
era characteristic data sent from the image detecting 
unit. 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] Fig. 1 is a schematic block diagram of a stere- 
oscopic image processing apparatus according to the 
45 present invention. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

so [0012] An embodiment of the present invention will 
now be described in detail with reference to the accom- 
panying drawing. 

[0013] Fig. 1 shows the schematic construction of a 
stereoscopic image processing apparatus, which com- 
55 prise a stereoscopic image detecting unit 10 including 
two CCD (Charge Coupled Device) cameras 11.15 and 
a stereoscopic image processing unit 50- This stereo- 
scopic image processing apparatus is mounted on a ve- 
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hide so as to obtain distance information from the vehi- 
cle to an object by processing a pair of picture images 
taken by two CCD cameras 11,15 and to recognize the 
configuration of roads or solid objects based on distance 
information obtained, ^ 
[0014] The two CCD cameras 11. 15 are mounted in 
the vehicle in a horizontally aligned relation at a pre- 
scribed distance away from each other These two cam- 
eras have a variable shutter speed mechanism and are 
operated synchronously with each other The optical ax- io 
es of lenses 12, 16 are arranged in parallel with each 
other. One CCD camera 11 comprises a CCD 1 3 which 
is an image sensor for transforming images formed by 
the lens 12 into electric signals and a video signal gen- 
erating circuit 1 4. The video signal generating circuit 1 4 ^5 
is composed of an amplifier for amplifying the signals 
from the CCD 1 3. a synchronous signal synthesizing de- 
vice for oulputting compound picture signals (video sig- 
nals) which are synthesized by picture signals from the 
amplifier and synchronizing signals, and a timing signal 
generating device for generating timing signals to con- 
trol the CCD 1 3 and the amplifier. The other CCD cam- 
era 15 has a similar construction comprising a lens 16, 
a CCD 17 and a video signal generating circuit 18. 
[0015] The stereoscopic image detecting unit 10 in- 25 
corporates a flash memory 1 9 defined as a first non-vol- 
atile memory and a micro-computer 20 therein. The 
flash memory 1 9 is a memory for storing correction data 
to correct the dispersions of the characteristics of the 
cameras 11, 15. Further the micro-computer 20 is for 30 
controlling shutter speeds of the CCD cameras and for 
reading out the correction data from the flash memory 
19 to send them to the image processing unit 50. 
[001 6] The correction data stored in the flash memory 
19 include data for correcting the optical deviation be- 
tween two CCD cameras 11. 15 by means of image 
transformation (affine transformation and the like), data 
for correcting an actual angle of view in order to diminish 
the effect of the focal length and aberration of the lenses, 
data for correcting the effect of the deviation of the infi- •^o 
n'iie, point between two pictures, data for correcting the 
(difference of respective output characteristics of the 
CCDs 13, 17 in the CCD cameras 11, 15, data for cor- 
recting dispersions of respective signals caused by the 
difference in the circuit characteristics such as gain of -^s 
the amplifier and the like. 

[0017] On the other hand, the image processing unit 
50 has gain control amplifiers (GCA) 51, 52 which are 
variable gain videoamplifier for amplifying analogue pic- 
ture images from respective CCD cameras 11, 15, var- 
iable offset circuits 53, 54 for equalizing the offset 
amount of both inrtage signals and AID converters 55. 
56 for transforming analogue images into digital images 
having prescribed brightness gradations. 
[0018] Further, a look-up table (hereinafter, referred 
to as LUT) 57 is connected downstream on either of two 
circuits, in this embodiment, on the circuit of the CCD 
camera 15 side. The LUT 57 is for changing the sensi- 



tivity of the image signal from the AID converter 56. An 
output of the LUT 57 of one system (on the camera 15 
side)and that of the Al D converter 55 of the other system 
(on the camera 1 1 side)are inputted to a shading cor- 
rection table 58 which is constituted by RAM. In this em- 
bodiment, the LUT is disposed only on one system (on 
the camera 15 side), but otherwise it may be disposed 
on both systems (on both cameras 11,15 sides). 
[001 9] The image data of respective systems correct- 
ed by the shading correction table 58 are stored in image 
memories 59. 60 respectively and read out by a micro- 
computer 70. In the micro-computer 70. the respective 
image data are subjected to a stereo-matching, that is, 
the image on the reference side is successively com- 
pared with that on the compared side until finding the 
same pattern in two image data, and when the same 
pattern is found, the deviation amount (parallax) be- 
tween two images is obtained. Based on this deviation 
arrwDunt. the distance to an object is calculated and ex- 
pressed in numbers. This numeral information is assem- 
bled into three-dimensional image information and the 
configurations of roads^ solid objects and others are rec- 
ognized based on this three-dimensional image infor- 
mation. 

[0020] The image processing unit 50 includes a flash 
memory 71 defined as a second non-volatile memory 
for storing circuit characteristic data to correct the dis- 
persion of the circuit characteristic generated when 
manufacturing the unit. The circuit characteristic data in- 
clude control data of the GCA 51 , 52. control data of the 
variable offset circuit 53, 54, data to be sent to the LUT 
57, data to be sent to the shading correction table 58 
and the like. 

[0021] Thus constituted image detecting unit 10 and 
image processing unit 50 are not restricted in the mutual 
combination. That is. the stereoscopic image process- 
ing apparatus can be operative with an arbitrary combi- 
natk>n of the image detecting unit 10 and the image 
processing unit 50 only by connecting both units through 
video cables 30, 31 and a serial cable 32. 
[0022] In the stereoscopic image processing appara- 
tus obtained by arbitrarily combining the image detect- 
ing unit 1 0 and the image processing unit 50. when pow- 
er is introduced, the micro-computer reads out the in- 
herent characteristic data of cameras from the flash 
memory 1 9 and sends those data to the micro-computer 
70 of the image processing unit 50. 
[0023] In the micro-computer 70, the characteristic 
data of cameras is combined with the circuit character- 
istic data read from the flash memory 71 to establish the 
image transforming data for correcting the optical devi- 
ation between two cameras, the correction data for cor- 
recting focal lengths and aberrations and the correction 
data for correcting the deviation between the infinite 
points of two cameras. Further, in the micro-computer 
70, the voltage data for determining gain in the GCA 51 , 
the voltage data for determining gain in the GCA 52, the 
voltage data for determining offset in the variable offset 
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circuit 53, the voltage data for determining offset in the 
variable offset circuit 54. the table data of the LUT 57 
and the table data of the shading correction table 58 are 
established so as to be adapted to the inherent charac- 
teristic of the image detecting unit 10 actually connect- s 
ed. Among these data, the above voltage data are out- 
putted to the GCAs 51. 52. the variable offset circuits 
53. 54 through a D/A converter (not shown) and the table 
data are sent to the RAM constituting of the LUT 57 and 
the RAM constituting of the shading correction table 58 io 
respectively to make an initial establishment. 
[0024] When the initial establishment has finished, 
the system comes into an operative state. When the re- 
spective video signals from the CCD cameras 1 1 . 1 5 are 
transmitted to the image processing unit 50 through the '5 
video cables 30. 31 respectively the GCA 51 . 52 adjust 
the gain of the image signal according to the respective 
control voltages and the variable offset circuits 53. 54 
adjust the difference of offset between respective image 
signals according to the respective control voltages. 20 
[0025] The respective image signals thus adjusted for 
respective CCD cameras 11 . 1 5 are outputted to the A/ 
D converters 55, 56. in which those analogue image sig- 
nals are converted into the digital image signals having 
prescribed brightness gradations (for example. 256 gra- ^5 
dations in gray scale) by the reference voltage outputted 
from the D/A converter in the micro-computer 70. 
[0026] Further, the digital image data of one circuit is 
given to the LUT 57 of the next stage as address data 
and the gain and offset are adjusted rDore precisely 30 
therein. Further, the digital data of the other circuit from 
the AID converter 55 are given to the shading correction 
table 58 as address data and the reduction of brightness 
due to the shading phenomenon generated in the optical 
systems of the CCD cameras 11.15, are corrected and 35 
stored in the image memories 59. 60 respectively. 
[0027] Further, in the micro-computer 70. with respect 
to the images stored in the image memories 50, 60. mis- 
cellaneous optical corrections such as a correction for 
errors generated at image transformations, a correction '^o 
foe angle of view, a correction for deviation of infinite 
points and other corrections are made and thus correct- 
ed images are subjected to stereo-matchings. The 
three-dimensional image information thus obtained is 
used for miscellaneous recognition processes at the 4S 
next stage. These corrections and stereb-matchings 
may be performed in other circuits to be used only for 
these objects. Further, thus corrected images may be 
stored in respective memories 59, 60. 
[0028] The advantage of this invention lies in the ca- 
pability of manufacturing the stereoscopic image detect- 
ing unit 10 and the image processing unit 50 separately 
this leading to a substantial improvement in productivity. 
Further, in markets, even when the stereoscopic image 
detecting unit 10 or the image processing unit 50 is re- 
placed with the other corresponding one, the optical 
characteristic and signal characteristic can be automat- 
ically adjusted so as to be matched with each other. 



thereby repair works are greatly improved. 
[0029] In this embodiment, the characteristic data of 
cameras are sent from the image detecting unit 10 to 
the image processing unit 50 when electric power is 
turned on and they are combined for use with the circuit 
characteristic data menrvorized in the image processing 
unit 50, however it is not always necessary to send the 
characteristic data of cameras each time electric power 
is turned on. For example, the image processing unit 50 
may be provided with a flash memory for merrrarizing 
the camera characteristic data together with the circuit 
characteristic data, wherein the image detecting unit 10 
memorizes a unit identification code. When at fir^t elec- 
tric power is turned on. the unit identification code is writ- 
ten on the flash memory together with those character- 
istic data. Next, when electric power is turned on, the 
data stored in the flash memory may be used as they 
are unless changed otherwise. 

[0030] While the presently preferred embodiment of 
the present invention has been shown and described, it 
is to be understood that this disclosure is for the purpose 
of illustration and that various changes and modifica- 
tions may be made without departing from the scope of 
the invention as set forth in the appended claims 



Claims 

1 . A stereoscopic image processing apparatus having 
an image detecting unit ( 1 0) including a pair of cam- 
eras (11. 15) for imaging stereoscopic image pic- 
tures and an image processing unit (50) for 
processing said image pictures, characterised by: 

a first non-volatile memory (19) provided in said 
image detecting unit for memorising a camera 
characteristic data for correcting dispersions of 
characteristics between said pair of cameras; 
a means (20) provided in said image detecting 
unit for reading out said characteristic data from 
said non-volatile memory and for transmitting 
said data to said image processing unit: 
a second non-votatile memory (71 ) provided in 
said image processing unit for memorising a 
circuit characteristic data for correcting disper- 
sions of characteristics between two systems 
of said cameras; and 

a means (70) provided in said image process- 
ing unit for correcting image signals outputted 
from said pair of cameras based on said circuit 
characteristic data read out from said second 
non -volatile memory and said camera charac- 
teristic data sent from said image detecting 
unit- 

2. The apparatus according to claim 1 . wherein 

said camera characteristic data includes a da- 
ta for correcting a dispersion of an output charac- 
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teristic of an image sensor of said respective cam- 
eras. 

3. The apparatus according to claim 1 . wherein 

said camera characteristic data includes a da- 5 
ta for correcting a dispersion of a circuit character- 
istic in a video signal generating circuit. 

4. The apparatus according to claim 1 , wherein 

said circuit characteristic data includes a con- io 
Irol data of a gain control amplifier (51. 52) for 
changing a gain of image signals. 

5. The apparatus according to claim 1 , wherein 

said circuit characteristic data includes a con- '5 
Irol data of a variable offset circuit (53, 54) for var- 
ying an offset of Image signals. 

6. The apparatus according to claim 1 . wherein 

said circuit characteristic data includes a data 20 
- of a look-up table (57) for changing a gain of image 
signals. 

7. The apparatus according to claim 1= wherein 

said circuit characteristic data includes a data 25 
of a shading correction table (58) for correcting a 
dispersion of sensitivity per zone in said image pic- 
tures. 

8. The apparatus according to claim 1, wherein 20 

said camera characteristic data includes an 
image transforming data for correcting a deviation 
of the optical position of said pair of cameras. 

9. The apparatus according to claim 1. wherein 35 

said camera characteristic data includes an - 
angle of view correction data for correcting a devi- 
ation of focal length between lenses and the effect 
of aberration of lenses. 



10.. The apparatus according to claim 1, wherein 

said camera characteristic data includes a da- 
ta for correcting a deviation between infinite points 
of images taken by said pair of cameras. 
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(54) Stereoscopic image processing apparatus 

(57) A stereoscopic image detecting unit (10) has a 
first non-volatile nnemory (19) for storing inherent cam- 
era characteristic data therein and an Innage processing 
unit (50) has a second non-volatile memory (71) for stor- 
ing inherent circuit characteristic data therein. When the 
stereoscopic image detecting unit is connected with the 
image processing unit through a serial cable and video 



cables and then electric power is tumed on. the inherent 
camera characteristic data are sent to the image 
processing unit (50). In the image processing unit, 
based on the camera data sent from the image detecting 
unit and the circuit characteristic data in the image 
processing unit, data for correcting the optica! disper- 
sion between two cameras and the of signal character- 
istic are established. 
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